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Foreword 



ARI 7S an applkd research organisation dedicated to helping the Army solve 
pe&pk-relatedpwbleim^problems of selecting, assigning, training and equip- 
ping soldiers to optimize ttwir combat effectiveness. Applied research requires 
a bedrock of scientific hrwwledge provided by basic research, both in terms of tech- 
niques or methxxiohgies and of data. Withmt this adequate scientific underpin- 
ning, applied research is si^ject to trivial exploitatims of technology, or vxme 
to be constantly driven only by technology. ' 

ARFs uasic research program is our springboard to the future. Thrmgh this 
program we can devekyp the research capability to solve military problems of the 
next decade and beyond. This program is our opportunity to nurture the field 
ofbehavwral science, broadly defined. It allows us to imrk with mir colleagms 
in the nwre basic research areas to bring forth new scientific developments and 
breakthroughs in our various fields ofspedalizatim. 

A.PJ is dedicated to scimtific and technical excellence and to making the future 
fmwn sooner. The basic research program is one of our prime vehicles for this 
The efforts of this program, conceived within ARI and executed by external 
research institutions, advance behavioral science and contribute to the qroujth 
ofARVs scientific domains. 

Edgar M. Johnson 
Technical Director, ARI 
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Introduction 



This is th£ second annual report ofARVs basic research proffram. It describes 
the current focus ofths program and the individml research efforts sponsored 
within eax:h ofth£ thrust areas. In additim, this volume surveys pric/r years 
of this efforty outlining the chxmging size and scope of the program arid smie 
of the nwre significant accomplishments. A complete bibliography ^ arranged 
by topiml areas, of all research completed from 1972 to doAje is included. 

This program consists of basic research efforts which are deemed to be both 
of outstanding scientific merit and of critical importance in assuring ARVs 
obility to coriductfuture applied research a>i problems of the operatimal Army, 
piroughmt the years, we have received unstinting and invaluable assistance 
in shapin^i its direction and in casting the critical questicms to be asked by cnir 
coll£agu£s in the field. 7b all of you whose insights and scientific acumen make 
sveh a program viable, my sincerest thanks. 

Robert M. Sasmor, Director 
Office of Basic Research 
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ARI— Programmatic and 
Organizational Overview 



The Army Research 
Institute 

The Army Research Institute for the Behavioral and 
Social Sciences, informally known as ARI, is a field 
operating agency reporting to the Deputy Chief of Staff 
for Personnel. It includes civilian sdentisto and military 
personnel, as well as administrative and technical sup- 
port personnel. Complementing the headquarters and 
principal '^asearch center in Alexandria, Virginia, are 
seven field units and sbc scientific coordination offices. 
ARFs assigned Army mission is to maximize combat 
effectiveness through research on the acquisition, 
development, training and utilization of soldiers in 
miUtary systems. ARI research, primarily in the behav- 
ioral and social sciences, helps the Army to recruit and 
retain the best people by developing a scientific under- 
standing of soldiers and the tasks they perform. The 
understanding of human behavior — a continual subject 
of investigation for ARI scientists - leads to a better 
matching of soldiers to Army j- ^, improved equip- 
ment deagned with the soldier m mind, and better 
trained soldiers and units. This understanding is 
applied to maximize individual and organizational 
effectiveness in light of modem battlefield tactics that 
rely on ^jicreasingly advanced equipment and techno- 
logical systems. 

ARI within the Army 
Research Community 

ARI is one of some 25 laboratories operated by the 
Army. ARI traces its beginning and the advent of 
military psychology/ to a meeting of experimental 



psychologists at Harvard University in 1917. They 
gathered to discuss how psychology and the application 
of scientific methods could support national defense. 
This group was incorporated into the Army and during 
World War I developed the first mass screening instru- 
ments, which were used for draftee selection. It was 
reactivated during World War II. 

From 1943 on, the group underwent a variety of 
organizational changes, and addressed problems in 
such areas as soldier selection and job matching. As the 
Army experienced more complex situations, the mis- 
sion of this group gradually expanded until it included 
research on initial selection of soldiers, job matching, 
retention, training and design guidelines for ensuring 
that the increasingly complex systems being brought 
into the Army were compatible with human capabili- 
ties. In October 1972, the Chief of Research and 
Development within the Department of the Army 
brought ARI officially into being with this expanded 
mission. 

Today ARI is the Army's principal center for 
research on the human component in all aspects of Ar- 
my activities and systems. Applying state-of-the-art 
concepts and methods of the social and behavioral 
sciences, ARI scientific and technical staff help to solve 
current Army problems and to make future problems 
more manageable. ARI research improves Army effec- 
tiveness by finding the best ways to man the force and 
equip the men and women who continually meet the 
challenge of national defense. The research psycholo- 
gist and human factors specialist do this by applying 
scientific procedures to the selection of the best 
soldiers, making the optimal match between the avail- 
able human resources and Army job requirements, 
training effectively, and equipping soldiers with 
weapons systems designed to complement theu- human 
capabilities. 



ARI Locations 



JAPAN 





• PM TRADE 



• FIELD UNITS/SCIENTIFIC 
COORDINATION OFFICES 
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Organizational vStructiire of the Army Research Institute 



COMMANDER TECHNICAL DIRECTOR 



MANPOWER AND PERSONNEL 
RESEARCH LABORATORY 



S«uctloft and CteMlflcttlon 
Technical Arm 

• Predictor Devetopnwnt 

• Performance Measurement 

• Selection arxl Cla5Sificat.'>n 

Technotog/ Transfer 



Penonnel Utlllzatk>n 
Technical Area 

• Officer Acquisition 

• Recruiting 

• Retention 



Manpowar and Paraonnal Policy 
naaaarch Group 

• Manpower/Personnel Data Bases 
" Economic Policy 

• Personnel Allocation 



Laadanhip and Managamam 
Technical Area 

• Leader Assessment and 
Development 



SCIENTIFIC COORDINATION OFFICES: 

FORSCOM TRADOC FAR EAST 
EUROPE PM TRADE USAREUR 






BASIC RESEARCH 







SYSTEMS 
RESEARCH LABORATORY 



Batttaflald Infonnation Syetama 
Technical Aiaa 

• Adaptive Information Systems 

• System Embedded Training 

• Intelligence Aiding 



Syttama Manning 
Technical Area 

• System Manning Requirements 

• Human Performance 

Capabilities 



Bllaa Field UnK 

• Air Defense Systems 

• Force Structure 



R. Hood FMd UnK 

• Weapon System Evaluation 

• Target Axx^uisition 



R. Leavenworth FMd UnK 

• Command Group Training 

• Command and Staff Operations 



TRAINING 
RESEARCH LABORATORY 



lnatn»ctk>nal Tachnotogy Syatama 
Technical Area 

• Curriculum an6 Evaluation 

• Learning Technology 

• Computer-Based Systems 

Development 



Training and Simulation 
Technical Area 

• Maintenance and Logistics Skills 

• Performance Standards 

• Simulation System Design 



Product Davelopmant and 
TachtK>k>gy Office 



Praaidio of Monterey Field UnK 

• Combined Arms Performance 

• Performance Analysis/Evaluation 

• Collective Training Design 



R. Bennlng Field UnK 

• Bradley Fighting Vehicle 

• Larxl Navigation 

• Weapons training 



R. Knox Field UnK 

• Performance Improvement 

• Automated Training Technology 

• Training Technology RekJ Activrty 



R. Rudcar Field UnK 

• Right Simulation 

• Continuation Training and 

Combat Readiness 

• Selection and Institutional Training 



1 



Organization and 
Research Structure 

ARI 's core program falls into three nugor areas: man- 
power and personnel research, systems research, and 
training research. Three specialized laboratories 
associated with each technical area execute the 
research. The Office of Basic Research conducts a pro- 



gram that cuts across all three areas. Subordinate 
technical areas and field units fit into ARFs three- 
laboratory structure with current efforts aligned so 
that spec^Tic research thrusts are pursued by the field 
unit or technical area with the best available resources. 
Working with troops in the field not only permits ARFs 
scientists to apply research results, but it also provides 
them an opportunity to learn firsthand the research 
needs of the Army. 
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Manpower and Personnel 
Research Laboratoiy 

The Manpower and Personnel Research Laboratory 
focuses on designing and developing methods to im- 
prove the process of recruiting, selecting, assigning and 
retaining Army personnel. Related efforts seek to 
improve the effectiveness of military organizations, 
particularly through analysis of Army organizational 
structure, management and leadership, and the 
dynamics of unit cohesion. 

Systems Research Laboratory 

The Systems Research Laboratory conducts 
research on how to realize optimum performance from 
Army personnel who operate or interface with the new 
systems entering the Army inventory. Modem p^cho- 
logical concepts of human perception and cognition are 
applied to the design of computerized systems and the 
procedures for their use. the capabilities and limita- 
tions of human performance, as well as the people- 
related aspects of system design, affect Army efforts 
to design, develop and field equipment which people can 
easily operate and maintain. 

TVaining Research Laboratory 

The Training Research Laboratory, drawing on ex- 
isting theories of learning, motivation, cognition, 
measurement and evaluation, continuously examines 
and refines, through research and developinent, the 
training methodology and practices employed by the 
Aiiny. Current research seeks to identify the specific 
skills required for successful performance in the Army 
and ways to improve the basic skills of marginaJ per- 
formers in order to increase their chances for successful 
Army careers. Training research also is developing 
more cost-effective training methods through simula- 
tion and training devices. 

Office of Basic Research 

The Office of Basic Research conducts the basic 
research program, intended to fill gaps in the existing 
scientific methodology and data base. These gaps, if not 
addressed, would hamper or preclude A RFc ability to 
conduct its applied research programs three years or 
more in the ftiture. Basic research is implemented 
primarily through contractual efforts with the academic 
community. At the present time there are some 60 con- 
tracts, based on unsolicited proposals from different 
universities or organizations in the United States. In 
addition, a small number of efforts are supported within 
the European, Middle Eastern, and Far Eastern 
research communities. This program is conducted in- 



dependently of the applied research, but follows the 
same general programmatic lines as the three major 
ARI laboratories. 

Research Program 
Development 

Research and development in the Army is primarily 
hardware oriented and is based on developing systems 
to meet specific needs. It progresses through suc- 
cessive steps beginning with developing concepts and 
basic data, followed by testing of system prototypes 
and, finally, testing of related support systems. Within 
the Army research community this progression in- 
cludes the following levels: 

• Basic Research (6.1 funding)-concems research on 
theory and new techniques and methodologies 

• Exploratory Development (6.2 funding)-uses basic 
research results and tests their applicability in 
specific areas 

• Advanced Development (6.3 funding)-focuses on 
pilot testing of subsystems or total systems 

• Engineering Development (6.4 funding)-concems 
development of prototypes 

As part of the overall Army research program, ARFs 
efforts follow the same sequence. Unlike hardware 
development, however, research in the human compo- 
nent is non-system specific. Moreover, the research 
process is much more iterative than with hardware 
development; applied research often encounters unan- 
ticipated obstacles that lead back to basic research 
questions, which in turn, when answered, allow a more 
optimal applied solution to be developed. 

Army priorities have practical implications for the 
way ARI develops its research program, which is 
necessarily broad and multi-faceted. ARFs current pro- 
gram of applied research consists of four congressional- 
ly-defined funding categories: 

• Manpower and Personnel 

• Education and Training 

• Training Devices 

• Human Factors in Systems 

A complete description of this program is contained in 
the 1984 ARI Annual Report. An overview of the basic 
research program at ARI, including its organization 
and development, is presented in the next section. 
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Basic Research Program at ARI 



OflSce of Basic Research 

Basic Research at ARI is managed by tha Office of 
Basic Research. It focuses on the future. The mission 
of the Basic Research Office is to create a cumulative 
behavioral science knowledge base on which to build 
new technologies for impro^ 'ng the effectiveness of 
Army personnel and to expand the scope of the under- 
lying scientific base. While the search for these tech- 
nologies is driven by Army needs, their development 
often results from significant breakthroughs by 
pioneering researchers. Because of this, the basic 
reseai-ch program is designed to involve innovative 
civilian scientists in research relevant to the Army. The 
findings of relevant new research supported by the pro- 
gram ultimately could produce high pay-ofif solutions 
to projected problems in the operational Army. 



Background 

The Army's involvement in basic research can be 
traced back to the 1960s and Project THEMIS, the first 
Army-wide efifort to provide a broad and continuing 
base of support for academic research considered vital 
to the national defense. Although there had previously 
been some support for selected basic research projects, 
THEMIS ofifered the stable financial base necessary to 
ensure continuing involvement of the academic research 
community in basic research oriented to the military. 
The behavioral science portion of the program was 
jointly sponsored by the Army Research Office, High- 
land and the Army Personnel Research Office, an early 
predecessor of ARI. 

By 1972, the Army had four separate programs of 
basic research, each associated with an Army organ- 
ization already conducting applied research. Through 
maintaining this close association between basic and ap- 
plied research efiforts, the Army fosters the transfer of 
basic research findings into more advanced stages of 
research. This enables basic research findings to have 
a direct impact on procedures and systems embedded 
within the functional, operational Army. 

The four programs of basic research, as currently 
structured, are: 

• Physical and Mathematical Sciences— sponsored by 
the Army Research Office at Durham, North Car- 
olina, a part of the Army Materiel Command, the 
Army's materiel development agency. In any given 
year this program accounts for approximately 75 
percent of the Army's basic research (6.1) effort. 

• Medical Science-sponsored by the Deputy 
Surgeon G^rneral for Research and Development, 
and accounting for approximately 12 percent of the 
Army's 6.1 efforts. 

• Civil Engineering-sponsoredby the Deputy Chief 
of Engineering for Research and Development and 



accounting for approximately 8 percent of the 
Army's 6.1 efforts. 

• Behavioral and Social Science Research-jointly 
sponsored by the Human Engineering Laboratory 
(Aberdeen Proving Grounds) and ARI and account- 
ing together for approximately 5 percent of the 
Army's 6.1 effort. 



Basic Research at ARI: 
1972-1984 



When ARI was established in 1972, the basic research 
program was executed in three portions, each managed 
by a separate unit within the newly formed organiza- 
tion. Basic research in militaiy sociology, training and 
motivation was conducted through the Motivation and 
Training Laboratory. Basic research in human factors, 
including symbology and some initial research on deci- 
sion processes, was carried out by the Systems Re- 
search Laboratory. Basic research on more global 
issues was executed through the Office of the Ttedmical 
Director. While the separate efforts reflected technical 
excellence, and most showed promise for transition to 
advanced or applied research, the basic research pro- 
gram OS a ^' *hole lacked an integrated thrust. 

As a first step in this direction, all basic research ef- 
forts were consolidated within the Technical DirectDr's 
office. In 1974, the ;$1.5 million budget for basic research 
constituted approximately 6.6 percent of ARI's total 
$22.2 million budget. In order to maximize the benefits 
of th? small budgetary resources available to the pro- 
gram, a two-tiered system was established to review 
all proposed basic research endeavors prior to funding. 
A committee of bench scientists performed a peer 
review U) determine the technical excellence of each 
basic research efifort. Following this review, an exec- 
utive conrmiittee, composed of senior ARI manage- 
ment, then assessed the relevance of each efifort to 
future applied research. This group made reconmien- 
dations to the Technical Director. Both review groups 
rotated members, and the review process encompassed 
the entire scope of the Institute's research interests. 
The executive conrmiittee was chaired by a representa- 
tive of the Tfechnical Director, responsible for long- 
range planning at the Institute. Throu^ this represen- 
tative, it was possible to ensure that the basic research 
program was integrated with the Institute's future 
plans. 

In 1978, ARI management initiated the next in a 
series of moves to sharper the programmatic focus of 
the Institute's basic research efiforts. At that time, 
there was growing conmiitment among senior Army 
management to develop and institutionalize techniques 
for organizational efifectiveness within the Army. 
Acknowledging that conmiitment, ARI management 
set aside a fixed portion (between 25 and 30 percent) 
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of the year's basic research funding to support appro- 
priate underlying theoretical research in that area. This 
was the first time that a deliberate management stra- 
tegy was imposed on the basic research program. 

Throughout the 70s, a period of rapid technological 
change, the need for basic research grew significantly. 
To meet this need more effectively and still remain 
within the strict budgetary limitations imposed on the 
program, ARI estabUshed, m 1981, a separate Office of 
Basic Research, reporting directly to the Technical 
Director. Simultaneously, programmatic emphasis was 
focused on m^or thrusts with a new one beginning each 
fiscal year. Though not excluding other promising 
efforts, this focus has ensured adequate support to 
areas deemed most vital to ARFs future applied 
research programs. In FY81 the program focused on 
Analysis of Cognitive Ability; in FY82 on Instructional 
Strategies; m FY83 on Intelligent Systems (Artificial 
Intelligence Applications). In FY84 the emphasis was 
on broadening and consolidating these thrusts. 



Selected Accomplishments 
1972-1984 

These examples represent selected accomplishments 
of the basic research program during the past twelve 
years. 

Leader Match for Army Training 

This effort validated Fiedler's Contingency Model of 
Leadership Effectiveness for officer training and led 
to the development of an Army-specific syllabus and 
instructional manuals. The manuals have been adopted 
by TRADOC, ROTC and are in use throughout the 
Army ROTC. 

Decision Making in Diagnostic Skills 

This research developed general decision strategies 
for all equipment trouble-shoot'ng regardless of com- 
plexity. This effort also elaborated these strategies in 
a computer based, context-fiw, non-equipment specific 
diagnostic task, which was shown to improve perform- 
ance on specific equipment repairs. This project pro- 
vided the basis for a new training approach now in use 
at the Army Signal School, Ft.Gordon. 

Cognitive Learning Strategies 

This research tested the relative effectiveness of 
various learning strategies for different learning situa- 
tions and determined which were optimal for certain 
tasks. It also established that these learring strategies 
could be taught to students. Following this, an instru- 
ment for diagnosing students' entry level learning 
strategies and deficiencies was developed and fielded. 
The diagnostic test, the Learning and Study Strategy 
Inventory (LASSI), has received wide acceptance with- 



in the education/training community, and the assess- 
ment results are bemg utilized by ARFs Trafaiing 
Research Lab in planning and executing advanced 
development on specific Army problems. 

Problem Complexity and 

Troubleshooting Strategies 

This project addressed the problem of transfer of 
training fi^m simple to complex problems, a major 
obstacle to practice applications of training techniques. 
The major finding was that problem practice in an un- 
familiar context led to strategies which transferred to 
other contexts if problems were of similar size or scope. 
To transfer problem solving strategies to considerably 
larger and more complicated problems in other con- 
texts, practice on intermediate size problems was need- 
ed. This finding led to the solution of underlying prob- 
lems in developing training progruns for transferable 
strategies. The results are being utilized in ARFs ap- 
plied training development program. 

G)mputer Ad^tive lasting 

Current tests of an individual's knowledge within a 
given domain are inflexible, give relatively little infor- 
mation and are easDy compromised. Procedures for 
developing a large item pool and selecting appropriate 
items tailored to an in-depth probe of a given in- 
dividual'sknowledge were develcped. The result is in- 
dividually tailored, faster, less easDy compromised 
tests, which provides a more accurate assessment of the 
individual's actual knowledge. This tri-service sup- 
ported basic research effort subsequently underwent 
field validation, also under tri-service support (6.4). 

Methodology for Intelligent Ck)mputer 

Adaptive Instruction (ICAI) 

This research represents a first step in developing 
truly adaptive and individually tailored computerized 
instructioa The system developed consists of a Com- 
petency Model of what the student should know; a Per- 
formance Model, representing the student's current 
state-of-knowledge; an Instruction Monitor, which can 
compare the two and determine the next sequence in 
the teaching program; and dialogue facOitation to im- 
prove interaction between system and student. The 
result is the first instructional system capable of custom 
tailoring its program to the needs and abilities of the 
individual student without intervention. These results 
provided the basis for initiating ARFs applied research 
on applications of ICAI. 

Identification of Research Needs for 

Human Factors (Committee on Human 

Factors, National Research Council) 

Human factors research is being increasingly driven 
by advances in technology rather than programmatic- 
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ally organized research considerations. To reverse this 
situation, a tri-service funded committee was establish- 
ed under the auspices of the National Research Council. 
The committee's purpose is to delimit and define target 
areas for human factors research so that the findings 
can be incorporated into the design of future Army 
systems. The 1983 report has helped to structure the 
areas and specific research nee^ for human factors 
military support for the coming decade. Six areas so 
identified and currently being explored are: 

• Human Decision Making 

• Eliciting Expert Judgment 

• Supervisory Control Systems 

• User-Computer Interaction 

• Population Group Differences 

• Applied Methods 

The Committee continues to function and has proven 
an invaluable asset to the Services by continuing to re- 
define the expanding fix)ntiers of the field. 

Human Components in 

Combat Simulation 

Existing combat simulation models for officer train- 
ing do not take human actions into account, a problem 
sufficiently serious to have warranted Army Science 
Board review and concern. This effort reviewed exist- 
ing combat models to identify: (1) explicit and implicit 
human interactions in their modeling, and (2) the sensi- 
tivity of simulated battle results to assumptions con- 
cerning such actions and iiiteractions. Three points of 
maximal sensitivity in simulated combat models were 
identified, and the specific parameters involved were 
identified. This led to an applied research effort to 
develop the necessary information to implant into such 
models so that they will serve as more realistic aides 
for future officer combat training. 

Discrete Levels of Human C^acity in 

Defense Forces Readiness and Combat 

Based on initial research measuring different levels 
of abstract conceptual ability, ranging from the most 
concrete to the most abstract, and also determining that 
the requirements for more abstract, longer term think- 
ing increase as on»; goes up the organization, including 
military organizations, training requirements for new 
senior level executives were explored. Specifically, the 
requirements for and impact of discrete levels of con- 
ceptual ability on different levels of organizational com- 
mand, leadership deve opment, senior military stafiSng, 
oflRcer efiRciency, and information, communication and 
control process were explored. Overall impact on readi- 
ness and combat performance was assessed. Addi- 
tionally, analysis of anticipated work requirements a 
decade hence yielded a different overall pattern of skill 



requirements, with a radically different organizational 
staffing structure. These results feed directly into a 
Department of the Army Task Force on General Offi- 
cer/Senior Executive Service Development. 

Basic Research Program 
Development 

The basic research program is organized and devel- 
oped along lines parallel to the applied research in- 
terests of ARI: manpower and personnel, education 
and training, and the human element in Army systems. 
The Basic Research Office analyzes the Army's needs 
in these areas, particularly as revealed in MAAs (Mis- 
sion Area Analyses) and related documents. It then 
determines how they might be met through new 
knowledge or application of emerging knowledge and 
technology. The Office plans and executes a progam of 
basic research aimed at filling perceived gaps in the 
knowledge and technology base reouired for the execu- 
tion of future exploratory and advanced development 
research programs. Proposed projects are evaluated 
primarily in terms of their relevance to the perceived 
needs for supporting future applied research, their 
scientific merit, potential payoff and their synei^stic 
impact on other work being supported. In order to en- 
sure that basic research efforts are properly integrated 
into the overall program, the Office participates in the 
long-range planning of the exploratory and advanced 
development research programs. 

Current Programmatic 
Scope 

ARFs current program in basic research must anti- 
cipate the Army's needs 20 years from now and beyond. 
Projections of the Army in the year 2000 and beyond 
suggest that there will be fewer people and that they 
will be of more diverse quality and makeup. TVaining 
time will increase, as will the cost of training. Increas- 
ingly sophisticated equipment and heightened depen- 
dence upon computer driven systems seem certain. The 
potential for data overload with information paucity, 
both in operations and maintenance, appears high. 
Looking toward future military encounters, the Air 
Land Battle 2000 envisions compressed time, informa- 
tion overioad, and a distributed battlefield with fewer 
people but ;vith an increased span of control. 

These projections have implications which, if taken 
seriously, impose many new requirements on the Army 
of the future. More accurate and faster methods for 
assessing abilities and skills will be needed. The Army 
will have to increase the individual's ability to learn and 
to operate at more abstract conceptual levels. Soldiers 
will have to be trained in multiple skills through faster, 
less costly and more generic training. All of this must 
occur with a lower ratio of trainers to trainees. Further 
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increased reliance on simulation appears imperative. 
In the area of computer aids, the Army must acquire 
devices capable of machine processing of information 
in real time; problem solvingfor maintenance, planning 
and decision making; distributed information process- 
ing and decision nisiing; and croup decision making. 
Command and control networks wfll be needed for in- 
formation sharing in planning and decision making. 

These projections into the future, and the require- 
ments they will impose on the Army, set the stage for 
the research trends of today. The next generation of 
applied research will have to emphasize information 
handling and engineering using computers. Most of 
these probably will be small, high speed and portable. 
To develop this technology, the Army needs to know 
how humans process information and what are the 
necessary and sufficient minimal conditions for infor- 



mation processing, lb explore, develop and blend these 
two lines of inquiry is the challenge for ARFs program 
in basic research, lb meet this challenge, the basic 
research program currently is focused in four principal 
areas: 

• ability assessment 

• instructional technology 

• cognitive processing 

• intelligent systems 

Brief introductions to these areas of focus, and descrip- 
tions of ARFs current and recently completed basic 
research projects in these technical areas, are provided 
in the following section of this report. 
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Basic Research Area: 
Ability Assessment 

The problem of assessing and measuring the innate 
abilities and the acquired skills and knowledge of in- 
dividuals is one of critical importance to the Army. This 
bears on individuals entering the Army as well as those 
already in the service. Basic research in this domain 
centers on two major thrusts: Assessing Cognitive 
Capability and Assessing Specific Knowledge and 
Skills. 

Assessiyig Cognitive Capability-The focus of this 
thrust is to find improved methods of assessing the 
cognitive skills and abilities which individuals possess. 
Within this thrust, new approaches to measuring the 
innate intellectual abilities of individuals are being ex- 
amined. The development of new methodologies, for 
measuring intelligence of individuals is of primary im- 
portance to the Army. Of greatest concern are methods 
to develop testing procedures that will provide more 
detailed information and a more definitive profile of an 
individual's abilities. 

That in di viduals function at different levels of concep- 
tual abstraction is a well known fact. Research in 
abstract conceptual ability is attempting to define these 
different levels of abstract conceptual ability and to 
measure an individual's current level otfunctioning. 
Research also is seeking to determine whether in- 
dividuals can be trained to go fix)m one level of abstract 
conceptual functioning to a higher one, and if so, how. 
Within this thrust is included basic research to explore 
the concept that learning time can serve as a measure 
of potential. 

Assessing Specific Knowledge and Skills—The prob- 
lem of measuring an individual's level of attainment 
after skill training remains a constant concern within 
the military. Newly developed measurement tech- 
niquesusing computer adaptive testing show promise, 
but the validity and test-retest reliabiSty of such com- 
puter adaptive testing require further research. 

Wiihm this thrust is basir; research in the area of 
nonverbal skills assessment. Despite the visual display 
capabilities inherent in computer adaptive testing, 
much of th e current testing focus is on verbal cognitive 
skUls. The problems of testing nonverbal skills, such as 
spatial and manual abilities, remain to be addressed. 

Current Research: 

Coinponente of Verbal Intelligence 
StembergA^ale University 

This research is part of Sternberg's attempt to 
develop a new functional definition of 'intelligence' and 
a culture-free test for it, based upon the way in which 
individuals process information of different types in 
various situations. In this study, the processes by which 
individuals determine the meaning of text and the 
meaning of unknowTi words based on context is being 
investigated. This information will allow for better 



prediction and diagnosis of an individual's level of 
verbal intelligence and for trailing of those persons 
deficient in verbal comprehension skills. Sternberg is 
conducting the study using an approach that borrows 
fix)m a wide range of methodologies new to the intelli- 
gence research field. Using this integrated approach, 
he is focusing on two basic questions relevant to the 
Army's needs: (1) what are the kinds of cues people use 
in learning word meanings ft-om context, and (2) what 
are the processes and the knowledge base on which 
such cue utilization draws. Both the reading passages 
used in the study and the decisions asked of subjects 
are of a Veal world' nature, relating to the types of 
materials found in newspapers, magazines, and tech- 
nical texts and manuals. This research is being co- 
sponsored with the Office of Naval Research. 
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tioniri the development of verbal concepts. Develop- 
mental Remeiv, U, 113-138. 
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human intelligence. Behavioral and Brain Sciences, 
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Human Problem Solving in 
Complex Dynamic Environments 

Rouse/Georgia Institute of Technology 

This project focuses on skills relevant to problem 
solving in complex, computerized, change monitoring 
systems. Problems arising in such systems, whether in 
communication, transportation, or manufacturing, re- 
quire user or operator intervention, and an increasing 
demand is being placed on human intelligence and 
resourcefulness as the systems grow more complex. 
This study addresses four questions: (1) what cognitive 
skills are used in the diagnosing of a problem and its 
correction, (2) what cognitive skills art used in coor- 
dinating these two tasks, (3) can training improve these 
skills, and (4) what measures of problem complexity are 
best suited for predicting skill requirements in such 
tasks. Rouse has designed a simplified, abstract net- 
work control scenario as the first phase of the study, 
and wfll manipulate relevant variables as the study pro- 
gresses. As specific skills relevant to such system 
problem-solving are identified, training will be 
developed for those skills, and more productive super- 
visory control procedures for problem solving in 
human-computer interactive sj'stems in dynamic envi- 
ronments will begin to emerge. 
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Training for Cognitive Complexity 
StreufertA^ale University 

The goal of this study is to enable the Army to select 
the best available person for a complex task and ade- 
quately train him or her for it. It is becoming apparent 
that current measures of intelligence and level of train- 
ed skill are not adequate predictors of performance with 
respect to jobs that are highly complex in terms of 
cognition — jobs that, for example, require ? large 
amount of strategic planning. More information is need- 
ed to determine how information is processed; how 
ideas, thoughts, and object perceptions are associated; 
and how plans are made. This study addresses two spe- 
cific questions: (1) to what degree training in cognitive 
complexity can be successful, and(2) which trainingpro- 
cedures can be most successfully applied across the 
broadest spectrum of tasks. Further, as part of this ef- 
fort, Streufert aims to develop a reliable technique for 
measuring an individual's current level of cognitive 
complexity functioning. 

Operators* Internal Models of 
Complex Dynamic Systems 
vS^ckens/University of Illinois 

This project is investigating the process by which in- 
dividuals create internal representations of complex, 
dynamic systems. Every individual who is charged 
with operating a complex human or technological 
system, from the supervisor of a nuclear plant to the 
commander of a military unit, at some point develops 
amenta] representation of how that system functions. 
This representation, at whatever level of sophistication, 
makes it possible for the operator to control the system 
arid detect failures when they develop. Unfortunately, 
little is known about how this cognitive process works 
— knowledge that could help reduce the number of acci- 
dents or miscalculations caused by shortcomings on the 
part of operators by finding ways to help them develop 
more functional models fester. Wickens is working with 
subjects in a variety of systems in which operators' con- 
trol and decision making are complicated by an exten- 
sive set of valuables that are not deterministic — such 
as the military conunander who must anticipate enemy 
movements in order to direct his own unit. 



The Meaning and Function 
of Military Experience 

FiedlerAVashington University 

It is generally accepted that prior military job experi- 
ence is desirable for most military command assign- 
ments, yet little is known definitively about the rela- 
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tion between experience and leadership performance. 
This study attempts to identify (1) what military officers 
mean by experience, (2) wha; elements they consider 
important in judging the quality of an individual's ex- 
perience, and (3) how various elements in an individual's 
work history contribute to leadership performance. 
Fiedler is basing his data on the personnel records and 
questionnaire responses of the 100 or so Army officers 
acting as subjects. Each subject's superiors and peers 
also will be asked to evaluate him or her in terms of 
leadership performance. With the resulting informa- 
tion, the Army should be able to better predict how ofiR- 
cers will function in certain positions following promo- 
tion, and what training will improve their performance. 
References: 

Barnes, V. E., Potter, E. H. Ill & Fiedler, F. E. (1983). 
The effect of interpersonal stress on the prediction of 
academic performance. Journal of Applied Psychol- 
om 68, 686-697. 

Bettin, P. J., & Fiedler, R E. (1984). The effects of 
leadership experience on organizational perfar- 
rmzwce; A rme?^ (Technical Report No. 84-5). Seattle: 
University of Washington. 

Fiedler, F. E. (1983). New tools for new times. Pro- 
ceedings of the Air University Leadership and Man- 
agement Symposium (pp. 203-234). Maxwell Air 
Force Base, Alabama: Leadership and Management 
Center. 

Fiedler, F. E. (1983). Tailoring the leadership situation 
to fit your style: Leader match training. In Concepts 
for Air Force Leadership (pp. 4-29 to 4-36). Maxwell 
AF Base, Alabama: Air University. 
Fiedler, F. E. (1984). Cognitive resource utilization and 
leadership performance: A preliminary model (Tech- 
nical Report No. 84-1). Seattle: University of Wash- 
ington. 

Fiedler, F. E. (1984). The contribution of cognitive 
resources and leader behavior to organizational per- 
formance (Technical Report No. 84-4). Seattle: 
University of Washington. 

Fiedler, F. E., Jobs, S. M. & Borden, D. F. (1984). 
Downward transmission of stress and its effect on the 
performance of motivated and unmotivated leaders 
(Technical Report No. 84-2). Seattle: University of 
Washington. 



Dynamic Personnel Job Management Modeling 

Chames/University of Texas 

The purpose of this project is to extend the current 
personnel job management model to account for per- 
sonnel reactions to team scenario changes. Personnel 
job management modeling is a method of determining 
whether an individual is compatible with a specific team 
scenario. It aids in selecting the right individuals for the 
right jobs. However, current personnel job manage- 
ment modeling is static and does not account for per- 
sonnel reactions to change in team scenario conditions. 
The extended model will incorporate individual flex- 
ibility, adaptability and efficiency responses to 
dynanuc, or changing, situations. It wiU provide a more 
realistic basis for predicting individual-team scenario 
compatibility and improve personnel planning and per- 
sonnel utilization. 
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Basic Research Area: 
Learning and Instruction 

In an era of rapidly changing technology and soaring 
training costs, the need to develop more rapid and effi- 
cient methods and systems for providing instruction for 
training and retraining is of paramount concern to the 
Army. Research in this domain is categorized in three 
major thrusts: Instructional Strategies, Computer 
Based Instruction and Expanding Learning Sldlls. 

Instructional Strategies— To improve the Army's in- 
structional systems, basic research in individual learn- 
ing strategies seeks a better understanding of the 
methods by which individuals acquire, process, and in- 
corporate new information. Related research in analy- 
tic reasoning strategies also is underway. As individ- 
uals become more proficient in solving particular types 
of analytic problems, it appears that they discard the 
linear paradigm by which they were taught to approach 
such problems. Experts talk about approaching such 
problems in terms of their perception of "correctness" 
or the "pattern" of the situation. Abetter understand- 
ing of this expert approach will lead to the design of 
more efficient strategies for teaching such skills. 

Computer Based Instruction-ARl sponsored 
research has demonstrated the feasibility of using com- 
puter based instruction (CBI) to develop psychomotor 
skills. Further research is needed to develop CBI pro- 
cedures for training psychomotor skills and for deter- 
mining optimal schedules for such training. Research 
is also needed on the types of situations and constraints 
under which such training can be accomplished and to 
develop suitable criteria for performance measurement 
in thearea of psychomotor skills. For the training pro- 
cess to succeed, easy and reliable performance mea- 
sures are essential. Research in this area is laying the 
groundwork to convert computer based instruction into 
individually tailored, interactive instructional sysi^ems 
— that is, it is the precursor to intelligent computer 
adaptive instruction (ICAI) systems. 

Expanding Learning Skills— Recent research sug- 
gests that the perceptions behavioral scientists have 
of theability of individuals to learn may have been more 
narrow than reality indicates. Basic research in this 
area is seeking to overcome the so called "natural 
limitations" long believed to be inherent in humans' 
ability to learn. Further, follow up on new findings in 
the area of "split brain" learning seeks to explore the 
phenomenon of right brain versus left brain learning 
and its implications for Army instructional systems. 

Current Research: 

Training in How to Learn 

Weinstein/University of Texas 

In this study, Weinstein is focusing on training in- 
dividuals in how to learn. At a time when technology 
is demanding more of recruits in order to achieve pro- 
ficiency in their area of specialization, their basic learn- 



ing abilities must be improved. In addition, studies have 
shown that some soldiers in the current cohorts come 
to the service poorly equipped to learn. Given these 
facts, it is important for the Army to develop ways of 
increasing the effectiveness of its training programs. 
One approach is to instruct students in the use of par- 
ticular learning strategies, i.e., techniques for organiz- 
ing and interpreting new information. In this study, 
Weinstein is trying to: (1) identify individuals who can 
benefit from instruction in learning strategies, (2) 
evaluate the needs and entry level knowledge of indi- 
vidual learners, and (3) develop instruction targeted at 
individual deficits and characteristics. This research 
also is studying the cost-eflfectiveness of various learn- 
ing strategies so that the Army will be able to devise 
and implement the most cost-effective training 
programs. 

References: 

Weinstein, C. E. (1984). Spacial strategies: Implications 
for applied research. In D. F. Dansereau & C. D. 
Holley (Eds.), Spacial Learning Strategies: Tech- 
niqweSy Applications^ and Related Issues. New York: 
New York Academic Press. 

Instructional Design 

Based on Problem Solving Behavior 

Steinberg/University of Illinois 

Steinberg is investigating the methodological dif- 
ferences between novices and experts confronted with 
situations that involve deductive reasoning. In the 
Army, as elsewhere, there is a pressing need for people 
who can solve problems requiring deductive reasoning, 
such as diagnosing a medical condition or a technolog- 
ical malfunction. These are problems that cannot be 
solved by applying a fixed set of rules in a prescribed 
order. Schools have not been able to effectively teach 
problem-solving techniques of this kind, partly because 
so little is known about the deductive reasoning pro- 
cess. This research seeks to identify effective deductive 
problem solving techniques to determine whether 
these techniques can be taught, and whether an indi- 
vidual's deductive reasoning capabilities can be assess- 
ed prior to assignment and training. 
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Macroprocesses and Adaptive Instruction 

Tobias/City University of New York 

Theobjective of this study is to provide instructional 
systems designers with information on the procedures 
used by different individuals for the cognitive process- 
ing of instructional information. Although there has 
been a great deal of research on the relation between 
students' achievement and teachers' observ^able in- 
structional techniques, there has been little research 
on how differences in individuals' cognitive processing 
affect achievement. This study will investigate whether 
differences between instructional methods are re- 
flected in the level of achievement when they provoke 
different macroprocesses in students. Accordingly, 
defining the different macroprocesses and instruction 
w^hichare optimal for various types of material and in- 
dividuals should lead to more effective instructional 
systems. 
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Cooperative Learning: Impact on the 
Acquisition of Knowledge and Skills 
Dansereau/Ttexas Christian University 

Dansereau's study will provide empirical data to sup- 
port the growing interest in students learning by inter- 
acting with one another. The project uses pairs of 
students learning scientific texts in a cooperative 
fashion. Dansereau is attempting to: (1) determine the 
effects of various cooperative learning strategies on the 
acquisition of academic knowledge and skills; (2) evalu- 
ate the impact of individual differences in such things 
as status, prior knowledge, and cognitive style on coop- 
erative learning; (3)explore ways to facilitate transfer 
from cooperative to individual learning; and (4) investi- 
gate how cooperative learning activities relate to 
various memory and text processing theories. These 
results also will provide insight into improving future 
interactions between students and computer instruc- 
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tional systems by allowing for the incorporation of such 
cooperative approaches into future computer based in- 
structional systems. 
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The Relationship of Simulator Fidelity to 
Task and Performance Variables 

Allen/Gteorge Mason University 

Allen is seeking to establish whether greater physical 
and/or functional similarity (fidelity) between simula- 
tors and real systems increases the effectiveness of 
training and, if so, to what extent. He also is determin- 
ing minimal fidelity guidelines for training simulators 
in an effort to optimize the relationship between simu- 
lator fidelity and transfer of training, and cost in train- 
ingsimulator design. Currently, simidators which have 
less resemblance to the real system are thought to offer 
extensive advantages over real system "twin" models. 
They can assist the trainee through feedback and cues, 
and are generally more flexible in the number of skills 
for which they can train. In addition, they are signifi- 
cantly less expensive, may provide for quicker transfer 
of training, and can substantially reduce training 
hazards. However, there is a lack of hard evidence to 
substantiate and measure these proposed advantages, 
and no guidelines exist defining minimal fidelity. This 
research is attempting to address both of these 
problems. 



Individual and Task Differences in 
Understanding and Using Instructions 

Smith/Bolt, Beranek & Newman, Inc. 

This study focuses on the process of how people 
understand instructions. The success of a modem 
military force depends in large measure on the capa- 
bilities of the individuals who have to operate, maintain 
and repair its equipment. Unfortunately, as technology 
has become more complex, the written instructional 
manuals used by Army personnel have frequently 
proven to be inadequate. Many of the difficulties asso- 
ciated with developing instructional manuals can be at- 
tributed to the lade of data on how people understand 
instructions for performing a task or procedure. Smith 
is studying: (1) what types of mstructions result in op- 
timal understanding and performance for different 
types of tasks; and (2) how individuals with different 
levels of cognitive ability understand and execute 



written instructions. These foldings will provide a basis 
for improving the design of militaiy training doraments 
and guidelines for determining what types of jobs cer- 
tain people can be most effectively trained to perform. 
This research is being co-sponsored with the Office of 
Naval Research. 

References: 
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Individual Difference Effects in 
Human-Computer Interaction 

Ambai'dar/Northeastem Illinois University 

This study focuses on the problem of providing access 
to computerized information in a way most compatible 
with the cognitive style of the individual user. It is Am- 
bard«r's hypothesis that efficiency in accessing infor- 
mation can be increased if individual differences in 
cognitive style are taken into account in designing 
human-computer interfaces. To tost this hypothesis, 
Ambardar is employing a four-step research plan: (1) 
Those characteristics of cognitive style most likely to 
affect interface features will be identified; (2) A simu- 
lated interface will be used to study these interactions 
within the context of real-life information retrieval; (3) 
A non-amulated interface will be substituted; (4) The 
research results will be verified by evaluating thp cogm- 
tive styles of users of existing compute; ^^stems. if the 
hypothesis is borne out, the research results will pro- 
vide substantial input to design guidelines for compat- 
ible human-computer interfaces, a major problem in 
developing "user friendly" computeriztid systems. 
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Test of the Stabilization-Error Theory of Retention 

Jones/Pennsylvania State University 

The purpose of this project is to enable the Army to 
minimize skill loss through more effective training. To 
minimize skiU loss, training processes must be deagned 
and structured in accordance with individual retention 
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capabilities and must compensate for skill loss over 
time. In this study, Jones is evaluating the stabiliza- 
tion-error theory of retention and developing a frame- 
work for understanding individual differences in retain- 
ing skills. The stabilization-error theory suggests a 
method for analyzing the optimal point in training for 
maximum retention and provides a means to predict 
the retention capabilities of individuals. The framework 
developed by Jones will serve as a guide for grouping 
individuals with equal retention capability for training. 
In addition, it will serve as a design tool for adjusting 
the length and level (structure) of training to ensiu'e ac- 
ceptable performance over time. 



Memory and Learning Strategies 

R. Bjork/University of California, Los Angeles 

A common way in which human memory breaks 
down, particularly in rapidly changing military situa- 
tions, is through a failure to update efficiently, par- 
ticularly when confronted with information overload. 
This research is exploring ways to code information and 
U. sequence it in such a way as to aid the updating pro- 
cess and thereby enhance retrieval at a later time. It 
is known that successful retrieval of information from 
the human memory, as in a test, makes the subsequent 
retrieval of that information on a later occasion far more 
likely. This effort is investigating the mechanism or 
mechanisms through which this retrieval of information 
enhance,; the strength or accessibility of that informa- 
tion in oiic's memory. Several different control pro- 
cesses under investigation show promise in overcoming 
difficulty in retrieval from long-term memory and may 
constitute a means of overcoming "natural limitations" 
in human memory. 



The Effect of Guided Imagery and Internal 
Visualization on Learning 

Meier/The Center for Accelerated Learning; 
Caskey /Texas Tech Unive sity 

This effort examined the effects of mental imagery 
on short-term and long-term retention of learning 
materials. Meier and Caskey found that presenting 
learning material through mental imagery leads to 
higher achievement both on tests of immediate recall 
and of long-term retention. This improvement was 
reflected across various demographic groups, academic 
maj ors, socio-economic backgrounds, and levels of abD- 
ity. Meier and Caskey's research has provided / jmy 
trainers with a significant new basis for enhancing 
learning, particularly in tasks requiring the rote 
memory of sequential data. 

References: 
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Reading Competencies and Practices 

Guthrie/International Reading Association 

The purposes of this investigation were (I) to con- 
struct measures of reading competencies that are fre- 
quently needed in an occupational environment, and 
(2) to describe the influence of the components of 
reading practice on these competencies based on the 
conceptual framework of ethnographic psychology. 
Guthrie found that traditional tests of reading com- 
petency may not be adequate measures of competency, 
particularly of those competencies required in a mili- 
tary or occupational environment. Itappears that sus- 
tained activity of reading leads to improvement of par- 
ticular means of processing written language to fulfill 
the goals of the processor. Depending upon one's pur- 
pose in reading, different levels and types of competen- 
cy are attained. Moreover, there is a high correlation 
amung specific practices and specific competencies. As 
a result, practices of reading may b e intimately tied to 
competencies for reading and may actually be con- 
strue 1 as their origin. 

These findings have significant relevance to the 
Army. The volume of printed materials supporting 
niilitary systems has increased substantially in recent 
years. Not surprisingly, the amount of time a recruit 
spends engaged in reading is also on the increase, as 
is the difficulty of the material due to the high tech- 
nology involved. This has raised concern about how to 
react to reports of soldiers' reading conpetency and the 
reliability of the tests for assessing reading competency 
relevant to a soldier's military occupational specialty 
(MOS). Guthrie's work forms the basis of a new and sig- 
nificant approach to determi*- ' the extent of func- 
tional Oliteracy and taking \ jpriate corrective 
measures. 
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Novice Strategies for Comprehending 
Technical Texts 

Larkin and Dee-Lucas/Camegie-Mellon University 

Despite the obvious and growing need for reliable and 
effective ways of transmitting technical knowledge to 
novice learners, little is known about how readers 
understand technical prose. Studies of technical knowl- 
edge structures have generally focused on the more 
stable and well-defined structures of experts, whereas 
studies of reading strategies and learning from text 
have focused on narrative (story-like) rather than tech- 
nical expository text. Larkin and Dee-Lucas are in- 
vestigating how novice learners comprehend technical 
texts. The research is examining the nature of compre- 
hension strategies used by novices and how these 
strategies influence what is learned from technical 
texts. The focus is on the extent to which novices use 
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and modify their "normar' comprehension processes 
in developing strategies for organizing and integrating 
technical infonnation. The classes of strategies under 
investigation are attentional strategies, organizational 
strategies, inferential processes and infonnation reduc- 
tion strategies. This effort is intended to yield a basic 
understanding of these processes that might be used 
by text designers and instructorsof novices to produce 
more reliable and effective text instruction. The results 
vAW indicate how technical texts for novice learners 
should be designed. The results may also suggest in- 
structional strategies for improving novices* under- 
standing of these texts. 



Roles of Information Feedback in 
Motor Skill TVaining 
Schmidt and Shapiro/ 
University of California, Los Angeles 

This research is investigating how information feed- 
back functions to aid learning. Inform^'^tion feedback in 
the form of knowledge of results is generally regarded 
as one of the most important variables for cc mplex skill 
learning. Scientific understanding of how this type of 
information feedback operates is limited because 
researchers have generally failed to separate the tem- 
porary perfomiance effects from the relatively perma- 
nent learning effects. As a result, the role of feedback 
of knowledge of results in learning is relatively unclear. 
Drawing upon the results of their previous research, 
Schmidt and Shapiro hypothesize that knowledge of 
results has a particularly strong guidance role but not 
necessarily an equally strong learning role. During ac- 
quisition , behavior is powerftilly guided by knowledge 
of results, often to the detriment of future perfor- 
mances where such knowledge is lacking (and to the 
detriment of learning), because learners may come to 
rely too heavily on it. The goal of this research effort 
is to extend this earlier knowledge using far more prac- 
tice and more complex tasks, and to examine issues not 
only for learning but also for long-term retention and 
transfer. This research is attempting to provide a new 
more effective basis for structuring real- world practice 
sessions with respect to the delivery of information 
feedback. 



Basic Research Area: 
Cognitive Processing 
Limitations 

The Army is entering an era in which larger, more 
rapid, and increasingly sophisticated computer-driven 
information processing systems are proliferating. As 
a result of this increasing reliance on such systems, the 
study of the limitations on human cognitive processing 
and what can be done to compensate for these limita- 
tions is of critical concern to the Army. Research in this 
domain is organized in three major thrusts: Man- 
Machine Integration, Information Overload and Deci- 
sion Making. 

Man-Machim Int€gration--The overriding concern 
in the area of man-machine integration is to develop 
design guidelines to ensure that future systems are 
compatible with human use. Especially important is the 
development of guidelines for optimal allocation of 
tasks between the human user and the computer, tak- 
ing advantage of the unique sldlls of both. 

Informution Over/ood— As automated systems pro- 
vide individuals vnth more and more information, the 
need grows for a theoretical structure to determine 
how best to package information for different types of 
settings, situations, and tasks. Approaches forpackag- 
ing and presenting information which will alleviate the 
overload condition, under various levels of operating 
load and time pressure, need to be developed. 

Decision Making—ESorts are underway to reach a 
greater understanding of the decision making process, 
especially regarding organization of information. Basic 
resea^'oh is needed to address how individuals organize 
and use information in making a decision and the ways 
in which they weight the validty and importance of in- 
coming information relevant to that decision. In addi- 
tion, future systems probably wiD require decision mak- 
ing by groups of varying sizes, composed of individuals 
at some distance from one another. These individuals 
may or may not share a common data base, either in 
part or in whole. Basic research on procedures for 
group decision making and for determining the need for 
shared data bases is required. In regard to decision 
making per se, it is now known that even experts are 
subject to systematic bias of which they are unaware. 
Identification of these types of bias and development 
of methods to deal with them is critical. Additional 
research is needed to determine how decision makers 
are affected by factors such as uncertainty regarding 
the total situation or the validity of specific inputs. 

Current Research: 

Information Processing Using a 
Structured Framework 

Sage/University of Virginia 

The purpose of this research is to develop procedures 
that are useful as aids to enhance human infonnation 



18 



24 



processing with specific relevance to Command, Con- 
trol and Communiration Infomnation systems. The cen- 
tral goal is to develop a structured information process- 
ing framework, based on logical reasoning, that will 
allow identification of various forms of cognitive bias 
in information formulation, analysis, and inter- 
pretation. An ancillary, but equally important, goal is 
to develop debiasing procedures to avoid the various 
forms of cognitive bias. One result of the research will 
be an evaluated structured framework for information 
presentation in systems which will help to alleviate 
users' cognitive biases. 
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Procedures for Learning to Interact with a 
Computer Based Information System 
Foss/University of Texas 

The goal of this study is to provide an accurate model 
of how the novice acquires understanding of a computer 
based system. Foss is testing the hypothesis that the 
novice learns the process by which the system operates 
more quickly when presented with an appropriate 
metaphor (conceptual model), from which he can make 
predictions about the behavior of the system in un- 
familiar situations. Foss is also studying how the se- 
quence and amount of information presented on com- 
mand languages affects learmng. In addition, he is ex- 
amining how acquiring the metaphor and learning the 
commands compete for the limited "cognitive re- 
sources** of the learner. The findings will permit the 
development of better guidelines for the design of in- 
structional and operational procedures f jr computer 
based information systems. 
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Methodology for Assessing 
Organization of Information 

Hock/Florida Atlantic University 

This research involves the development of a 
methodology to investigate and measure the size of the 
functional units in wWch visuaUy presented information 
is processed by humans. Previous research on human 
memory has shown that information about the frequen- 
cy of events is coded automatically, with little influence 
from the individual's levels of intelligence and educa- 
tion. In this research. Hock is seeking to identify func- 
tional units of processing by determining whether sub- 
jects accurately monitor the frequency of occurrence 
of the units under investigation. In addition to addrejrs- 
ing some fundamental issues in visual search, selective 
attention, conceptual abstraction, and pattern recogni- 
tion, this research offers the possibility of enhancing 
understanding of how individuals assimilate informa- 
tion concerning the likelihood of events and contingen 
cies between events in various situations. Overall, the 
research offers promise for developing a method to 
organize visual information more efficiently in large in- 
formation collection and retrieval systems, while im- 
parting contingency information to the user — informxr 
tion of vital importance often overlooked. 
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Quantification of Risk Assessment 
Wallsten/University of North Carolina 

TWs research represents an attempt to apply quan- 
titative values to judgments at high risk in real world 
situations which parallel those occurring in military 
operations. It is an attempt to determine how human 
decision makers assess risk and to provide a common, 
objective, quantified vocabulary for such 'jse. This 
research is a unique attempt to study the process of ex- 
perts' subjective valuaaons of real world risk situations 
and to quantify this procedure. The goal is to provide 
a stable basis for communication and understanding 
among two or more individuals, or systems, assessing 
risks in complementary or overlapping situations. 
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Human Factors Steering Committee 
Deutsch/National Research CouncO 

ARI, the Office of Naval Research, and the Air Force 
Office of Scientific Research, later joined by NASA, 
established the Human Factors Steering Committee 
to explore basic research needs for human factors. This 
resulted fix)m concern that the field was being so force- 
fully driven by developments and changes in tech- 
nology that significant programmatic issues were being 
overlooked. There was also concern that basic research 
in tho area of human factors was becoming too frag- 
mented and lacked a programmatic overview. The com- 
mittee consists of 12 rotating experts in various areas 
of the human factors field. The report issued by the 
committee at the end of the second year has had a 
distinct impact on the development of basic research 
in the field, not only within government laboratories, 
but also in the academic and business community. 
Because of the high return on the small investment, the 
committee has been retained and is exploring and at- 
tempting to define certain areas of critical concern to 
military systems such as supervisory control situations, 
and simulation device fidelity requirements. 

Conditions Associated with Interference Between 
Processing Demands in One Cerebral Hemisphere 
Green/Georgia Technology Research Institute 

This study focuses on the ''interference" that occurs 
when one side of the brain must both process a stimulus 
and make a response to the stimulus, as occurs in the 
processing of large amounts of complex and competing 



visual information, a situation often encountered in 
military tasks. How successful an individual is in per- 
forming such a task depends in large measure on 
whether or not the task itself causes interference be- 
tween stimulus processingand response control within 
the same cerebral hemisphere. A stimulus appearing 
in the left visual field, for example, will project to the 
right hemisphere; likewse, movement of the left hand 
is controlled by the right hemisphere - hence the 
possibility of interference between stimulus processing 
and response control. The objective of this study is to 
identify conditions that enhance performance when 
stimulus processing and response control originate 
within one hemisphere, as well as when they originate 
in separate hemispheres. Identification of the condi- 
tions under which interference occurs will allow task 
design that takes such effects into account. For in- 
stance, visual displays for tasks with a high level of in- 
terference could be designed so that stimuli initially 
project to the hemisphere not controlling the response. 
The findings also vvill provide an understanding of how 
rapid visual information processing is accomplished and 
help to resolve contradictory findings in the existing ex- 
perimental literature. 
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Meanings of Non-Numerical Probability Phrases 
Wallsten/University of North Carolina 

This project, conducted in two parts, focuses on the 
frequent use of such phrases as ''probably," 'Very like- 
ly and "possibly" as a barrier to effective communica- 
tion on the battlefield. As previous research has demon- 
strated, the meaning of such phrases varies widely 
depending on the person speaking, the person being 
spoken to, and the particular circumstances involved. 
The first purpose of this study is to develop and validate 
techniques for quantifying an individual's under- 
standing of a given phrase in a given context. This is 
being done through computer controlled experiments 
in which subjects are asked to make judgments about 
the relative likelihood of an even t, based on a numerical 
and nonnumerical description of it. The second phase 
of the study will investigate the effects of context and 
individual characteristics on the understanding of these 
phrases. Wallsten will conduct experiments similar to 
those in the first phase to ascertain the answers to such 
questions as: (1) Do people with different kinds of train- 
ing systematically use probability words differently? 
(2) Do the words have different meanings when applied 
to positive and negative events? (3) How do modifiers 
such as "very" or "not" affect meaning? (4) Does the 
choice of phrase depend on the amount of information 
supporting the judgment? The results will be particu- 
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larly useful to the Army in training future decision 
makers and in instructing them on how to communicate 
effectively with one another. 

Aiding the Human Decision Maker Through 
Knowledge Based Sciences 
Sage/University of Virginia 

This project mvolved the planning and conducting of 
a woricshop that will include representatives from three 
different disciplinary areas: artificial intelligence, deci- 
sion analysis, and cognitive science. In attempting to 
make improvements in cognitive functions such as 
judgment, decision making, planning, and resource 
allocation, the Army tends to receive conflicting advice 
from individuals representing different professional 
perspectives. During the workshop, individuals involv- 
ed in these three areas, each with its own set of research 
objectives and development priorities, will explore 
commonalities and differences. Among the specific 
topics that will be addressed are problems relating to 
battlefield management; intelligent automation; Com- 
mand, Control and Communication Information 
systems design; maintenance and maintainability of 
equipment; and other human-machine interface sys- 
tems. The problems within these areas are niany and 
varied, including incomplete knowledge, conflicting m- 
formation, ambiguity, changing environments, differ- 
ences in user experience, and irrelevant data. How- 
ever, the knowledge-based sciences have created an 
equally large array of opportunities with respect to the 
development of information systems. These opportuni- 
ties will be explored by workshop participants to the 
end of making consensus recommendations towards the 
goal of increased efficiency of the human component in 
Army systems. 



Constraints on Access: Costs and Benefits 
Franks and BransfordA^anderbilt University 

Learners acquire knowledge through instruction so 
that it can later be accessed when it becomes relevant. 
Inadequacies in learning, problem solving, and decision 
making often stem not ftx)m a lack of relevant knowl- 
edge, but from a failure to access knowledge that was 
acqiured previously. This research investigates factors 
affecting the degree to which, and, more importantly, 
how people become aware of the relevance of pre- 
viously acquired knowledge for such tasks as problem 
solving, learning, and decision making. Franks and 
Bransford will also investigate both negative and 
positive implications (cost-benefit effects) associated 
with access to previously acquired information. 



Cognitive Processing 

E. BjorkandKaye/ 

University of California, Los Angeles 

This research project is assessing basic components 
of nonverbal intellectual ability including spatial ability 
and memory. One component of spatial ability appears 
to involve switching one's attention, independent of eye 
movements, to different locations in the visual field in 
order to process large amounts of briefly presented in- 
formation. While componentsof this ability may repre- 
sent innate automatic responses, people may vary in 
their ability to utilize cues as to ho w they should manip- 
ulate their attention for optimal visual processing. In 
this case, it may be possible to train the strategies that 
will enable efficient allocation of attention to different 
spatial locations. Further, since this ability may be 
related to skills of mental rotation, the discovery of 
ways to train efficient attention switching may general- 
ize to many types of nonverbal spatial problem solving. 
EEG/Polygraph equipment is being used to monitor 
the underlying neural components of attention switch- 
ing behavior. 

A second element of this effort addresses the up- 
dating capability of human memory, that is, one's abili- 
ty to keep memory current. Without such a process, 
people would quickly become overwhelmed by the 
massive amounts of information they must process and 
remember each day. When memory updating breaks 
down, there is a reinstatement of interference owing 
to previously learned but no longer current informa- 
tion. Uang a pupillometer as an independent measure 
of cognitive activity, Bjork and Kay e hope to isolate the 
specific conditions that result in breakdowns of this 
valuable updating process. The isolation and discovery 
of such conditions should provide possible solutions for 
problems created by information overload. 



The Role of Data and Feedback Error in 
Inference and Cognition 

Doherty and Tweney/Bowling Green State University 

Increasingly, decision makers utilize information pro- 
vided by computers to make judgments, predictions, 
inferences, and decisions. This trend raises concern, 
particularly in military settings, about the conse- 
quences of errors in the information provided to deci- 
sion makers. This new research explores the impact on 
inferencmg behavior of errors introduced through a 
system failure which produces data unrelated to the 
true state of the information. While the role of uncer- 
tainty has been explored by psychologists, there has 
been virtually no work on uncertainty created by errors 
in the information provided to the subject by the en- 
vironment. This effort addresses this area through 
manipulation of the amount and nature of the error in 
the environment on a trial by trial basis and through 
observation of the effects on several measures of per- 
formance in inference and prediction tasks. 
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Assessment of Relation Between Asymmetry 
in Cerebral Hemisphere Arousal and Perceptual 
Asymmetry 

Green/Georgia Institute of Technology 

Recent research suggests that asymmetry in the 
relative arousal of the two cerebral hemispheres may 
be an important factor in explaining individual dif- 
ferences in a wide range of behaviors. Green is investi- 
gating a ne^y approach for assessing individual differ- 
ences affecting human performance. She has hypothe- 
sized that individual differences in perceptual aoym- 
metry may be related to individual differences in asym- 
nietry of cerebral hemisphere arousal. If this is so, 
simple behavioral measures for assessing perceptual 
asynmietry can be used to make valid inferences 
regarding asymmetry of cerebral hemisphere arousal. 
This effort is attempting to quantify the relation be- 
tween asynmietry of hemispheric arousal and percep- 
tual asymmetry. Research also will focus on identify- 
ingother correlates of arousal asynmietry. The overall 
goal is to identify behavioral correlates of arousal asym- 
metry that can be used for purposes of personnel 
assessment. 



Basic Research Area: 
Intelligent Systems 

Much of the work pursued under the three domains 
previously discussed concerns the methods by which 
individuals process information. In contrast, research 
carried out within this domain is exploring issues 
related to the machine processing of information under 
various tasks. This area deals with applications, and, 
in some cases, extensions of techniques initially 
developed in the artificial intelligence and cybernetics 
communities to problems in behavioral science re- 
search. The four major thrusts within this domain are 
Knowledge Representation, Learning, Problem Solv- 
ing and Planning. 

Knowledge Representation— ARl supports a pro- 
gram of basic research in the field of knowledge 
representation. One of the ma^or underlying problems 
of many large scale systems is determining how to col- 
late and organize information for future use and the Bp- 
propriate categories and mechanisms for retrieving it 
at the needed time. Research on human knowledge has 
resulted in a variety of knowledge structures: hierar- 
chies, networks, schematic representations, proto- 
types, lists and rule-based systems. A critical issue is 
what kinds of representations are most appropriate for 
various knowledge domains and purposes. 

Research is needed on methods of knowledge trans- 
fer, from one expert or a variety of sources, into a com- 
prehensive system. Methods of coding, collating, 
organizing, storing and retrieving need to be 
developed. Research is also needed on flexibility of 
knowledge representations, representing dynamic in- 
formation, and inclusion of value information or 
weighting in knowledge bases. 

Research is underway on knowledge creation. People 
use existing knowledge as the basis for generating new 
information, through inferential, deductive or inductive 
processes. Ihis little understood subject requires inten- 
sive investigation. 

Learning— A primary focus of research within this 
area is methods for initially creating new data bases 
from discrete information and for incorporating new in- 
formation into an existing data base. This latter topic 
applies both to information from the outside environ- 
ment and to internally generated input based on the ex- 
perience of an individual user or the system itself. Fin- 
ally, although it is well known that new taaks often are 
learned by extrs^lation from previous learning exper- 
iences, or through 'malogies, basic research is needed 
to explore the mechanisms by which humans accom- 
plish this kind of learning and how these mechanisms 
could be incorporated into machine programs. 

Problem Solving-The development of computerized 
aids for problem solving is of great interest to the 
Army, and ARI supports basic research in the methods 
and procedures used to solve problems. These include 
procedures of iterative branching techniques used in 
heuristic problem solving; rule based problem solving; 
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goal directed problem solving; the nonlinear approach 
often used by experts; and the inductive approach 
whereby individuals reason backward from fragmen- 
tary, less than perfect pieces of evidence to determine 
an underlying scheme, purpose, or reason. It is antici- 
pated that, in the future, some Army problems will re- 
quire rapid solutions fh)m two or more individuals 
physically removed from each other who may not have 
access to identical data bases. The types of network con- 
trols and mechanisms that will be necessary for such 
distributed group problem solving and the extent of 
data based redundancy required in such situations are 
of concern. 

PZannin^— Research is underway in the area of 
structured planning, particularly into the rules and pro- 
cedures used to plan for ill defined ftiture scenarios. 
ARI also supports research on how planners generate 
new goals, modify goals, and create alternate goals. 
Most current planning systems are limited in that they 
incorporate fixed goals which are incs^able of changing. 
This research aims at providing more ad^tive planning 
systems in the ftiture. 

ARI supports research to develop methods for incor- 
porating the user's value judgments into machine 
system planning operations. Experienced planners or 
decision makers often incorporate subjective value 
judgments into their planning and decision-making pro- 
cesses which they cannot verbalize but which often turn 
out to be valid. Tb date, automated systems do not 
possess such capabilities. 

Research also is underway on constraint modification 
and development of alternatives. Current planning 
systems have constraints built into them when they are 
initiated. However, constraints often differ according 
to level of importance, and some may be modified by 
human users during operations . To date little research 
has addressed how the ability to change constraints can 
be provided and under what conditions changes should 
be allowed. Additional areas of support include distribu- 
tive planning, in which experts in different subject 
matter areas are geographically removed from ea^^h 
other; generic planning, to develop systems capable of 
producing plans for different subsets of related areas 
or situations; and meta-planning, or planning for 
planning. 

Current Research 

An Intelligent Personal Aid for 
Planning and Decision Making 

Azad Madnie/Perceptronics, Inc. 

The objective of this project is to develop ;md demon- 
strate the feasibility of low-cost portable decision aids 
that can function in battlefield decision environments. 
In the 1990s and beyond, military commanders will 
have responsibilities created by technology that are far 
different andmore extensive than those oftheir prede- 
cessors. Rapidly, and under chaotic conditions, they will 
have to integrate intelligence information, use inno- 



vative techniques to avoid detection and to counter ad- 
vanced sensor systems, and direct multi-functional 
resources to meet the enemy threat. Specifically, 
Madnie will: (1) design an interactive decision aid for 
the elic'^ation, evaluation, and selection of options in 
battlefield conrunand tasks; (2) develop a user interface 
for this system which appropriately presents the criti- 
cal psychological and situational variables in the prob- 
lem solving process; and &) implement the decision aid 
using off-the-shelf personal microcomputers and hard- 
ware. 



Complex Decision Making 
P^k/Concordia University 

The primary objectives of this project are to combine 
two systems developed to train military personnel in 
decision making, and to pilot test the combined system. 
After the research, the experimental software will be 
transferred to ARI for applied research efforts. Suffi- 
cient laboratory work will have been done to warrant 
the use of these systems, and fiuther research then can 
be most expeditiously conducted in-house. Previous ef- 
forts have led to the development of two man-machine 
operating systems: (1) the Team Decision System 
(TDS), a complex space environment simulation system 
in which a mission is presented and cooperation among 
decision makers is required; and (2) THOUGHT- 
STICKE R, a system that can elicit, accept, manipulate 
and output statements of plans and strategies in train- 
ing or operational situations. It is envisioned that the 
combined system wiU be used for representing dedsion- 
makingproducts such as strategies and tactics, and for 
providing assistance to the decision process. Little is 
required in terms of new hardware; display devices 
such as simple graphics boards will be incorporated 
when necessary as the experiment proceeds, and these 
will be made compatible with existing ARI systems. 
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Retrieval of Knowledge Through 
Algorithmic Decomposition 

Slovic, Lichtenstein, Fischoff/Dedsion Research, Inc. 

In this study, the research team will examine the ef- 
fectiveness of various strategies for retrieving knowl- 
edge from memory. The stucfy has three objectives: (1) 
to learn more about how people store and recall infor- 
mation, (2) to study the effectiveness of aids based on 
algorithmic decomposition for knowledge retrieval, and 
(3) to explore the relation between accuracy and sub- 
jective conjBdence in tasks involvingfactual estimates. 
The algorithmic decomposition being investigated is a 
three-step method of information processing in which 
an individual first decomposes or breaks down a 
primary question into several sub^iuestions; then 
estimates answers to the sub-questions; and finally 
recomposes the answers to the sub-questions, using a 
rule, or algorithm, to arrive at an answer to the original 
questior. Knowledge gained of how human experts do 
this is a first step in incorporating similar procedures 
into future, real-time, computer driven systems. 
References: 
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Information Processing Organizations with 
Acyclical Information Structures 

Levis/Massachusetts Institute of Teclmology 

The inherent complexity of the Army's C:k)mmand, 
Control and Communications Information systems has 
seriously strained the csqjabilities of the human organi- 



zations that use the systems. The high cost associated 
with systems, the time lagbetween inception and proto- 
type testing, and the system complexity itself make it 
impossible to design systems on a trial-and-error basis. 
It is critical, therefore, to make an accurate assessment 
of the characteristics of the user organization early in 
the design process, so that the oi^ganization is not forced 
to adapt to the use of an inconvenient system. Levis is 
addressing the problem of developing an organizational 
model that reflects the actual decision structure (what 
types of decisions are made at what levels) and infor- 
mation structure (who has access to what type of infor- 
mation) in order to facilitate the design of a compatible 
information processing system. It is expected that this 
research will have significant applications for other 
organizations with interacting decision makers who (1) 
must use an information gathering and processing 
system to make decisions, and (2) may have overl^ping 
areas of responsibility and, in some cases, different sets 
of data. 

Semi-Automatic Synthesis 
and Refinement of Knowledge 

Michie/University of Edinburgh 

Researchers at the University of Edinburgh have 
recently developed computer programs tJiat are able 
to learn inductively following exposure to examples. In 
this project, Michie is studying whether machine syn- 
theses of concepts m%ht enable experts in a particular 
domain to extend their mental grasp into previously in- 
accessible areas by incrementally conceptualizing a 
complex problem and domain for them in an interactive 
mode. More explicitly, this research proposes to build 
into the machine system, judgmental rules which ex- 
perts use but which they cannot cleariy explicate. Once 
these are transferred to the machine, the machine 
system can use them to help the human decision maker 
to extend his or her understanding of extremely com- 
plex situations. The study will explore the possibility 
that such programs can be developed, and then develop 
procedures to measure the "knowledge" contained in 
the machine syntheses programs, by applying quan- 
titative values to the "goodness" of the judgmental 
material contained in the system. 



Development of a General Contingency Plannen 
Phase II 

Lehner/PAR Technology Corporation 

The overall objective of this research effort is to 
develop and test a general purpose planner that can 
solve adversarial planning problems in a variety of 
domains. It is acontinuationofapreviously conducted 
effort, "Planningunder Adversity": The Development 
of a (Contingency Planner, referred to as CP/x. The 
current effort focuses on developing language and ap- 
proaches for adversarial planning, multiple goal plan- 
ning, multi-agent planning, and, perhaps most impor- 
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tantly, real-time planniixg for corrective action as situa- 
tions develop or change. This area of automated 
planning is of the highest priority for the Army and sup- 
ports long-range planning for Air-Land Battle 2000. 



(1) allow for possible errors in the assessment and (2) 
tske into account the fact that the possible states of 
knowledge may not be equally distributed in the pop- 
ulation. 



Adiyitive Human/Computer Interface 
Using Exi>ert Profiles 

WilligesA^irginia Polytechnical Institute 

This research effort will investigate critical issues in 
the design of an adaptive human/computer interface 
using on-line expert profile generation procedures. As 
more and more people with different levels of computer 
skills interface with computers, the need for adaptive 
interfaces hasgrown. An adaptive interface is capable 
of tailoring dialogue to the characteristics of the user, 
his/her level of experience, and the task configuration. 

The objective of this research is to develop automated 
systems which use expert j^proaches to aid the novice 
in developing his/her own unique 2q)proach to the prob- 
lem domain, but which do not force the user to use the 
"experts' problem solution. The advantage to such 
d system is that the user would optimally have develop- 
ed his/her own approach and so would be better pre- 
pared to deal with real situations which do not confirm 
exactly to the conditions under which the expert(s) solv- 
ed the problem. 

ITus effort will refine the expert profile methodology, 
develop procedures for adaptive model building, and 
incorporate expertise into an adaptive assistant for 
aiding novice u.sers of computer systems. The results 
of this research will provide a broader understanding 
of critical components of intelligent interfaces which are 
tailored to individual users of complex computer-based 
systems. 

The Assessment of Knowledge: 
Theory aiid Algorithms 

Falmagne/New York University 

Fabnagne and his colleagues are attempting to design 
and implement efiRdent computer algorithms for 
assessing the knowledge individuals have of a specific 
body of Lriformation. This effort entails developing an 
appropriate formal language and an abstract theory 
specifying the structure of the possible states of knowl- 
edge in a population of subjects. In this research, a field 
of knowledge is conceptualized as a large set of ques- 
tions or problems. The knowledge state of any indivi- 
dual is the particular subset of all the questions that he 
or she can solve. Not all sets of questions are states of 
knowledge, and the set of possible states is constrained 
ratherthan open ended. An efiRcient algorithm for the 
assessment of knowledge takes advantage of the struc- 
ture of the possible states, and identifies each such state 
by a list of test-questions, together with their 
responses. An algorithm is efficient if, on the average, 
these lists tend to be short, so that the assessment can 
be fast. Probabilistic algorithms are considered which 



Distributive Problem Solving: Adi^itive Networks 
with a Computer Intermediary Resource 

Lyman/University of California, Los Angeles 

The thrust of this effort is to design optimal archi- 
tectxutd configurations for distributed problem solving 
protocols based on cognitive and artificial intelligence 
principles. Advances in hardware technology, by reduc- 
ing the size and cost of computer components, are 
making distributed ^stem ardiitectures economically 
feasible. A distributed group of problem solvers incor- 
porating in real time common computational aids and 
data bases for command and control ^sterns becomes 
realizable. Lyman is exploring the man-machine issues 
critical to achieving efiBdent distributed problem solv- 
ing systems. These include the availability of tech- 
niques and compatible protocols for data sharing; col- 
laborative information exchange; and models to control , 
guide, and coordinate the problem solving process. The 
objective of this effort is to gain a fundamental imder- 
standing of the structure and dynamics of the problem- 
solving process when it includes multiple interacting 
inputs and outputs fix)m interfaced humans and distri- 
buted computer systems. Little is known about the 
principles for guicKng the design of architectures for 
such systems, and tWs research is seeking a broader 
imderstanding of computer based, intermediator 
models that are a<fc^)tive to the requirements of generic 
as well as specific problem solving situations. 



Diagnosis and Remediation in the Context of 
Intelligent Tutoring Sjrstems 
Sleeman and Hess/Stanford University 

Computer assisted instruction (CAI) shows consider- 
able promise as a costreflfective means of individualizing 
instruction, especially for military training. Most ex- 
isting ^sterns individualize instruction only to a limited 
extent This is accomplished through padng, branching, 
and feedback governed by errors on a closed set of ques- 
tions. A more advanced form of CAI will require the 
ability to deal flexibly with students' errors and mis- 
conceptions. Artificial intelligence (AI) techniques can 
provide a basis for such individualized tailoring by in- 
ferring a model of the students' understanding, along 
with an explicit knowledge of the subject domain. Suc- 
cessful integration of both will provide the basis for an 
intelligent tutoring ^stem that is capable of using a 
specific teaching operation in immediate response to a 
student^s error. The specific focus of this research is to 
develop inference models of students' developing com- 
prehension of a given subject domain and to do this 
across multiple domains, looking for generalizable tech- 
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niques. These domains are algorithmic domains, do- 
mains which are inherently non-deterministic, and 
domains which are conceptual. In two of these areas, 
Sleeman and Hess will use the inferred models to 
develop a ^stem capable of intelligent individualized 
interaction with the student. 



Automatic Concept Formation in a 
Rich Input Domain 

Lebowitz/Columbia Univeristy 

Computer systems that process and store large 
amounts of information can operate more effectively, 
both in terms of storage and retrieval, if they auto- 
matically create new concepts fh)m their input. This 
research attempts to create a domain-independent com- 
puter system that will take large amounts of informa- 
tion about a given area, identify important concepts in 
that area, use these concepts to store the information 
in memory, and be able to answer questions about the 
data. Efforts will focus on the problems of comparing 
examples to form new concepts as well as on how to 
determine which examples to compare. Most existing 
research in artificial intelligence has consisted of sup- 
plying programs with examples of specified concepts 
and having the programs determine definitions of those 
concepts. In real-world problems, the crucial concepts 
to be learned— those that best help explain and organize 
information about the domain— are not pre-supplied; 
rather it is necessary to identify these concepts in a 



stream of veiy complex input data. This research will 
build on previous work of Lebowitz in order to construct 
an information system, largely domain-independent, 
that accepts a large quantity of facts about a given area, 
uses generalization techniques to derive important con- 
cepts, and uses these concepts to organize the informa- 
tion in an intelligent fashion. 



Technical Documentation: 

The Computer Solution of Word Problems 

Chamiak/Brown University 

This research is investigating the representation and 
use of "common sense knowledge" in computer under- 
standing of language and problem solving. To date, 
Chamiak's research in artificial intelligence has been 
primarily concerned with the construction of programs 
which can understand natural language and solve prob- 
lems within a single domain. These efforts stem from 
observations that language comprehension and prob- 
lem solving, which encompass aspects of knowledge 
engineering, have similar knowledge requirements. 
This project will extend the research from attempts to 
understand simple problems to an attempt to find a 
small set of problem-solving techniques, or even a single 
semantic representation, that will suit many different 
domains. The system to be developed will be based 
upon a unified set of programs for deductive informa- 
tion retrieval, syntactic parsing, and "low level" prob- 
lem solving, as well as a single "fitime" representation. 
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